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(54) Method of extracting features characterising objects 



(57) A method of extracting features characterising 
objects consists in discriminating an object from a con- 
text, the discriminating step comprising, determining the 
context consisting of at least two objects, choosing a 
topic object from the context, deriving feature sets of the 
topic object and the other objects in the context, judging 
whether there is at least one distinctive feature set in the 
features sets, deriving a new feature set of there is not a 

feature. 
defector 




distinctive feature set amongst the feature sets, and 
registering one of the distinctive feature sets as an out- 
come; and restarting the discriminating step when there 
exists an object which is not discriminated from the 
other objects. This method represents a selectionist 
approach to the characterisation of objects, driven by a 
discrimination task. 
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Figure 3: Feature detectors grow hierarchically as needed by the task domain. 



co 

CO 



Q. 
LU 



Printed by Xerox (UK) Business Services 
2.ie:aQ.4 



10 



EP0848347A1 

Description 

The present invention relates to the categorisation or characterisation performed by an agent (typically a robot or 
computer system) on the basis of perceived properties or qualities and, notably, the invention relates to the extraction 
of features characterising objects. 

The present invention consists in a mechanism for the automatic and spontaneous formulation of "meanings", 
which are perceptually grounded, under selectionist pressure arising from a discrimination task. 

The invention has arisen in the context of a larger research program to understand the origins of language and 
meaning using complex systems mechanisms such as serf-organisation, co-evolution, and level formation (see "Syn- 
thesising the origins of language and meaning using co-evolution and self-organisation" by L Steels in "Evolution of 
Human Language" edited by J. Hurford, Edinburgh University Press, Edinburgh, 1996c). 

The invention concerns the "meaning creation" process, that is, the method whereby the agent derives characteri- 
sation rules and/or information. A method is proposed whereby an autonomous agent may originate new meanings. 
The agentis autonomous in the sense that its ontology is not explicitly put in by a designer, nor is there any explicit 
75 instruction. 

For the purposes of the present document, meaning is defined as a conceptualisation or categorisation of reality 
which is relevant from the viewpoint of the agent Meanings can be expressed through language, although they need 
not be. ~ 

In very general terms, meaning takes many forms depending on the context and nature of the situation concerned 
Some meanings (such as colours) are perceptually grounded. Others (such as social hierarchies) are grounded in 
social relations. Still others (such as goals or intentions for actions) are grounded in the behavioural interaction between 
the agent and the environment. The present invention focuses on perceptually grounded meanings, although the pro- 
posed mechanism could also be used for other domains. 

The proposed method may be employed in a wide variety of different applications where agents (e g. software 
agents or robotic agents) autonomously have to make sense of their environment. This ability if especially important in 
the case of devices, such as unmanned exploration vehicles, which are required to navigate and perform tasks in 
and/or gather data concerning, a little-known and/or hostile environment. 

The description below focuses on "meaning creation" in a single agent Work is under way to also study "meaning 
creation" in multiple agents and investigate how a common language can act as a way to achieve a coherent conceptual 
30 framework between agents even though every agent individually builds up its own repertoire. 

There is no suggestion that the method according to the present invention corresponds enpirically to any proc- 
esses performed in the animal or human mind. This method does, however, enable artificial devices to create meanina- 
ful characterisation information in a wide variety of applications. 

There has been a lot of work on the problem of meaning creation particularly in the connectionist literature (see for 
35 example, "Explorations in Parallel Distributed Processing" edited by J.LMcClelland and D.E. Rumelhart MIT 
Press/Bradford Books. Cambridge. Massachusetts, 1986). A perception, for example, can be seen as a device that 
acquires a set of distinctions as relevant for a classification task The sensory channels are constituted by the inputs to 
the perceptron, and the weights perform the function of selecting out regions which will be input for the classification 
process. 
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The most important differences between these connectionist approaches and the present invention is that: 

(1) connectionist networks embed the build-up of a feature repertoire within the task of classification (as opposed 
to discrimination), and 

(2) an inductive/instructional approach as opposed to a selectionist approach is used. 

An inductive approach is based on going through a (typically large) set of examples which drives the weights step- 
wise to reflect the best classification. In a selectionist approach, a structure comes into existence by variation or con- 
struction and is then tested as a whole for fitness in the environment. Inductive approaches result in gradual 
generalization. Selectionism immediately gives generalisations which might be refined more gradually. 

The selectionist approach followed in the present invention is more in tune with work on feature generation in 
genetic algorithms research (see, for example, "Genetic Programming" by J. Kbza, MIT Press, Cambridge, Ma 1992) 
unsupervised learning as exemplified by the Kbhonen network (see "Self-Organization and Associative Memory" by T 
Kohonen, Springer Series in Information Sciences, vol.8, Springer Verlag, Berlin), and proposals, known as "Neural 
65 bSbooU 7?w Ybr M SST (SGe nNeUral Darwinism: 1716 TTleor y <* Neural Group Selection" by Q.M. Edelman, 

Edelman assumes that neuronal growth processes yield a primary repertoire stabilised by developmental selec- 
tion, which is then subjected to experiential selection, yielding a secondary repertoire of categories. Using re-entrant 
maps and degeneracy, categorial perceptions of different objects can be compared and generalised to classes. Mean- 
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ing creation and classification are clearly distinct here. The selectionist pressure in the case considered by Edetman 
comes from statistical signal correlations (for the formation of classes). By way of contrast, in the present invention, the 
selectionist pressure comes from a discrimination task. 

Below, after describing the invention in general terms, the proposed mechanisms will be explained more formally. 
Then some experimental results are reported, the final section of the description contains some conclusions. 

Considering, first the invention in general terms, it should be noted that agents engage in tasks relevant for their 
survival in a specific environment. Here the focus is on perceptually grounded discrimination tasks. The agent attempts 
to distinguish one object or situation from others using sensors and low-level sensory processes. The question is 
whether an agent is capable of developing autonomously a repertoire of features to succeed in discrimination and to 
adapt this repertoire when new objects are considered \ specific attempt to perform a discrimination and the subse- 
quent adaptation of the feature repertoire is referred to t^low as a "discrimination game". 

Let us assume that there is a set of objects, or more generally situations, which have characteristics that are 
sensed through sensory channels, either derived directly from sensors or from low level sensory routines. A sensory 
channel preferably is adapted to yield a value between 1 .0 and 0.0. For example, the sensory channels could capture 
properties of moving objects like size, speed, average grey area, etc., or, in a more general case, internal states reflect- 
ing motivations, sensations or actuator streams. Herein, the meaning creation process is first explained abstractly with- 
out reference to specific applications. However, laboratory experiments with real mobile robots, speech, and active 
vision yield a sensory basis for the mechanisms proposed here. 

A meaningful distinction takes the form of a "feature", which decomposes into an attribute and a value. The feature 
is derived by a feature detector which discretises the continuous space of one sensory channel. The feature indicates 
that the value of a sensory channel falls within one subregion of the space (see fig. 1). There are absolute features, 
such as '{colour recf)\ which are based on absolute values of a sensory channel for a single object, and relative mean- 
ings (such as '(speed faster) 1 ) which compare states of sensory channels for different objects. The present discussion 
only focuses on absolute features. A particular attribute is not necessarily relevant for each object. 

The present invention makes use of the hypothesis that "meanings'' can be based on construction and selection 
processes embedded in discrimination tasks. Each individual agent is assumed to be capable of constructing new fea- 
tures, i.e. new segmentations of the continuous sensory space. The process of generating diversity and variation is sub- 
jected to selection pressure coming from the discrimination task: The agent attempts to differentiate an object from a 
set of other objects, which constitute the context based on the available repertoire of features and values. A discrimi- ' 
nation may be based on one or more features grouped as a "distinctive feature set". There may be more than one pos- 
sible distinctive feature set, but also none if not enough features are available. This happens either because no feature 
could be found to characterise the topic, or the attributes used to characterise the topic were not applicable to the other 
objects in the context, or a feature does not make a sufficiently fine-grained distinction. When there is no distinctive fea- 
ture set the discrimination fails and there is pressure on the agent to construct new feature detectors. 

Feature detectors are refined in a hierarchical fashion and therefore form a kind of discrimination tree. The first 
detector divides the space up in some regions (in the examples given in the following description, always two regions). 
This region in its turn might then later be segmented by an additional feature detector if objects that need to be discrim- 
inated fell within the same region. Thus feature-detectors form natural hierarchies, which go as deep as required. 

The set of objects among which a discrimination has to take place is assumed to be open, in the sense that new 
objects may enter the environment that require different or more refined features. 

The present invention provides, in addition to a feature extraction method, apparatus adapted for putting this fea- 
ture extraction method into practice. 

Further features and advantages of the present invention will become apparent from the description below given in 
association with the accompanying drawings, in which: 

Figure 1 is a diagram illustrating the feature. perception process; 
Figure 2 is a diagram illustrating the process of discrimination; 

Figure 3 is a diagram illustrating how feature detectors grow as needed by the task domain; 

Figure 4 is a graph indicating how success in discrimination games changes with the number of games played, in 

a case where the number of objects is fixed; 

Figure 5 is a graph indicating how the number of features used, and the percentage of features used out of the total 
available, changes with the number of discrimination games played, in a case where the number of objects is fixed; 
Figure 6 is a graph indicating how success in discrimination games, and the number of features used, changes with 
the number of games played, in a case where the number of objects increases; and 

Figure 7 is a graph indicating how the total feature repertoire, and the percentage used out of the total repertoire, 
changes with the number of discrimination games played, in a case where the number of objects increases. 

A formal description of the characterisation process according to the present invention now follows. 
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TERMINOLOGY 

Let there be a set of objects O « {o y . ... , o m } and a set of sensory channels S = {<r f a n ), being real-valued 

functions over O. Each function o) define* a value 0.0 £ oj(Oj) s 1 .0 for each object 0|. 
s An agents has a set of feature detectors 

D . - 

to A feature detector 

is has an attribute name p a> a set of possible values V a * a function 4> a> and a sensory channel o,. The result of apply- 
ing a feature detector d a> *to an object o, is a feature written as a pair (p OJt u) where p is the attribute name and 

20 , 

the value. 

The feature set of a for o { is defined as 



Two features (ai (a 2 1)2) are distinctive if 

30 



35 *i * ^ A distinctive Mature set D J? f0f is a set of features distinguishing an object o, from a set of other objects C. 

= {f l f= (pu) e 

F *,or 311(1 Vo c e C either / Bf = (p , u , )e with p = p' or 3f € F 0 ^ with f and f 
40 distinctive}. 

Clearly there can be several distinctive feature sets for the same Ot and C, or none. 
45 DISCRIMINATION GAMES 
A discrimination game 
so d = <a,o t ,C> 

o!T a9 t^ a '«? °' and a 00018X1 C C 0n W' The outcome <* the same is twofold, Either a distinctive 

feature set could be found, D «, of * * and the game ends in success, or no such feature set could be found. D% Q t 
and the game ends in failure. *■ * ^ 

55 As part of each game the repertoire of meanings is adjusted in the following way by the agent: 

1. 
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°a,ot~ fi- 
le, the game is unsuccessful. This implies that there are not enough distinctions and therefore 

5 Voc€C,F cF . 

There are two ways to remedy the situation: 

10 (a) If there are still sensory channels for which there are no feature detectors, a new feature detector may be 

constructed. This option is preferred. 

(b) Otherwise, an existing attribute may be refined by creating a new feature detector that further segments the 
region covered by one of the existing attributes. 

15 • 

2. Da.ot * <i>- In a case where there is more than one possibility, feature sets are ordered based on preference cri- 
teria. The best' feature set is chosen and used as the outcome of the discrimination game. The record of use of the 
features which form part of the chosen set is augmented. The criteria are as follows: 

20 (a) The smallest set is preferred. Thus the least number of features is used. 

(b) In the case of sets of equal size, it is the set in which the features imply the smallest number of segmenta- 
tions which is chosen. Thus the most abstract features are chosen. 

(c) In the case' of equal depth of segmentation, it is the set of which the features have been used the most 
which is chosen. This ensures that a minimal set of features develops. 

25 

The whole system is selectionist. Failure to discriminate creates pressure on the agent to create new feature detec- 
tors: However, the new feature detector is not guaranteed to do the job. It will be tried (next time) and only thrive in the 
population of feature detectors if it is indeed successful in performing discriminations. 
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Implementation 

The dlscrin^ game defined above has been implemented and encap- 
sulated as an agent. The programs create a set of sensory channels and an 
iwtialset of objects which have arbitrary values for some of the sensory chan- 
nels A typical example is the mowing list of objects and associated values 
for channels: 

o-O: Csc-3:0.73] tsc-4:0.823 [sc-5:0.073 
o-l: Csc-0:0.89J Csc-3:0.023 Csc-4:O.S63 fcc-6:0.483 
, 5 o-2: Csc-0:0.74] Csc-1:0.923 Csc-2:0.22J Csc-3:0.563 

Csc-8:0.52J Csc-9:0.03] 
o-3: tsc-2:0.36] tsc-3:0.093 Csc-4:0.14] 
o-4: Csc-1:0.473 Csc-2:0.613 [sc-3:0.693 Csc-S:0.67J 

Csc-6: 0.143 Csc-9:0.433 
0-5: Csc-1:0.84] Csc-4:0.823 kc-5:0.703 Csc-8:0.8l) 
0-6: Csc-1:0.40] tsc-2:0.323 Csc-3:0.683 C«c-4:0.963 

Csc-5:0.413 Csc-7:0.143 C»c-8:0.763 
0-7: Csc-1:0.84] Cac-2:0.89] Csc-3:0.63] C«C-8:0.4U 
o-8: tsc-0:0.723 Csc-l:0.02J Csc-3:0.923 C«c-4:0.44l 

Csc-5:0.04] Csc-7:0.293 
0-9: Csc-l:0.3S3 Csc-2:0.723 Dic-3:0.583 Csc-4:0.34l 

A feature detector is a function assigning a feature-value to a certain 
attribute, The name of the attribute indicates its nature. It fs of the form 
*c<-ni-... where t is the sensory c h ann e l followed by the number of segments 
of each consecutive segment. For example, so-5-2 is the name of aa attribute 
whose feature detector operates onsc-5 and divides it in 2 regions, sc-5-2-2 
would be the name of an attribute that is a farther refinement, (sc-5-2 v-0) 
xs a feature combining this attribute with the value v-0. 

in.^r^Slf 1 ^^:* 11 * **** v***"™* g»es through aloop perform- 
ing the following activities: 

1. A context is delineated The context consists of the objects currently 
in the field of attention of the agent. currently 

2. One object in this context is chosen randomly as topic 

3 J 11 ? feature 8615 of *«* the other objects in the context are 

derived. 
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4. An attempt is made to find possible discriminating feature sets. 

We now show some typical situations far an agent a-5, which starts from 
no features at all. In the first game, a-5 tries to differentiate the object o-5 
from o-3. The agent does not have a way yet to characterise the topic and 
creates a new attribute operating on sc-5. 

a-5: o-5 <-> {o-3 > 
Topic : NIL 

Not; enough features topic 
New attribute: sc-5^-2 

The next game to distinguish o-5 from o-9 and o-l is already successful, 
because o-5 is again the topic The context contains objects that do not have 
any response for sc-5, and thus no features can be constructed: 

a-5: o-S <-> «Co-9 o-l > 
Topic: ((sc-5-2 v-1)) 
Context: (NIL NIL) 
Success: ((sc-5-2 vHL)) 

The next game is also sucessful because o-6 has value v~0 for sc-5-2, o-2 
has nothing and o-5 has v-1. 

a-5: o-6 <-> {o-2 o-5 > 
Topic: ((sc-5-2 vH))) 
Context: (NIL ((sc-5-2 v-1))) 
Success: ((sc-5-2 v-0)) 

In the following game the attributes are not sufficiently distinctive and 
therefore a new attribute is created. As long as there are possibilities to focus 
on additional sensory channels, existing attributes will not be refined The 
new attribute operates on sc~3. 

a-S: o-7 <-> {o-l o^2 > 
Topic: ((sc-1-2 v-1)) 
Context: (NIL ((sc-1-2 v-1))) 

No distinctive features but new one possible: (sc-2 sc-3 sc-8) 
New attribute: sc-3-2 
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When uncovered sensory (channels are no longer available, more refined 
feature detectors for existing attributes start to be made. In the following 
example, o-O fails to be distinguished from 0-8 and 0-1, even though a set of 
features is available to characterise each object. A refinement of the attribute 
operating over sc-5 is chosen. 

a-5: o-O <-> {0-8 o-l > 

Topic: ((sc-3-2 v-l)(sc-4-2 v-1) (sc-5-2 v-0)) 
Context: (((sc-0-2 v-1) Csc-1-2 v-0) (sc-3-2 v-1) 
(sc-4-2 v-0) (sc-5-2 v-0))) 
((sc-0-2 V-1) (sc-3-2 v-0) (sc-4-2 
No distinctive features but refinements possible. 
Ref inin g attribute: sc-5-2 => sc-5-2-2 

After a sufficient number of discrimination games the set of features sta- 
bilises. For the set of objects given above, the following is a stable dis- 
crimination tree. For each attribute the possible values are listed with their 
corresponding regions as well as the number of times a feature has been used. 

sc-5-2: 

v-0: CO. 00 0.503 358. 
sc-5-2-2: 

v-0: CO. 00 0.25] 31. 
Sc-5-2-2-2: . . 
v-0: CO. 00 0.12] 
sc-5-2-2-2-2: 

v-0: C0.00 0.06] ; v-1: CO. 06 0.12] 3. 
v-1: CO. 12 0.25] 
v-1: C0.2S 0.503 22. " ' 

v-1: CO. 50 1.00] 309. 
sc-1-2: 

v-0: CO. 00 0.50] 651. ; v-1: CO. 50 1.00J 628. 
SC-3-2: 

v-O: CO. 00 0.50] 713. ; v-1: CO. 50 1.00] 733. 
SC-8-2: 

v-0: CO. 00 0.S0] 15. ; v-1: C0.50 1.00] 8. 
sc-2-2: 

v-0: CO. 00 0.50] 99. ; v-1: CO. 50 1.00] 112. 



8 



EP0848 347A1 



SC-0-2: 

vH>: CO. 00 0-50] ; v-1: C0.50 1.00] 42. 
sc-4-2; 

v-0: CO. 00 0.50] 223. 
sc-4-2-2: 

v~0: CO. 00 0.25] 
v-1: CO. 25 0.50] 1. 
(att a-5 sc-4 2 2 2): 
v-0: C0.25 0.37] 5.; v-1: CO. 37 0.50] 5. 
v-1: CO. 50 1.003 215. 
sc-4-2-2: 

v-0: CO. 50 0.75] 1. 
v-1: CO. 76 1.00] 2. 
sc-4-2-2-2: 

v-Or CO. 75 0.87] 5. ; v-1: CO. 87 1.00] 2. 

sc-6-2: 

v-0: CO. 00 0.50] 2. ; v-1: CO. 50 1,00] 

We see that more abstract features, like {sc-1-2 v-O), are used more often. For some, like (sc-5-2 there is a 
deep further discrimination. For others, like (so5-2 v-1), there is none. Some features, like {sc-6-2 v-1), have not been 
used at all and could therefore be eliminated. Another experiment with the same objects but for a different agent a-6 
yields a different discrimination tree. In one example, some sensory channels (such as sc-6) were not used, sc-4 was 
no longer refined, etc. Usually there are indeed many different possibilities. 

When new objects enter an environment, it is preferable that the agent attempting to characterise objects in that 
environment should construct new distinctions if they are necessary. This is effectively what happens in preferred 
embodiments of the present invention. If new sensory channels become available, for example, because a new sensory 
routine has become active, then they will be exploited if the need arises. 

Experimental Results 

Fixed set of objects 

Fig.4 is a graph illustrating how the discriminatory capacities of a single agent evolve as the number of discrimina- 
tion games played by the agent increases, in a case where the total number of objects is fixed. In this example, there 
are 1 0 objects and 5 sensory channels. 

Fig.4 shows a typical example where an agent builds up a repertoire of feature detectors starting from scratch. The 
graph shows the increasing discrimination success as experienced by the agent in discrimination games. It also shows 
the global success with the features so far, i.e. all objects are compared to all other objects only based on their features. 
Progress in finding more discriminatory features depends on encountering those objects that require more discrimina- 
tion. Because context and topic are set probabilistically, this is not predictable. 

The graph in Fig.5 shows, for the same experiment, the increasing number of features (as a percentage of the final 
total (22) features reached at 'the end of the experiment), and the percentage of features that is effectively used. We see 
that many features created earlier on are only gradually used and there are still many cases that have not been encoun- 
tered. 

Increasing the set of objects 

In the next experiment (Fig.6), we start from a set of 10 objects and gradually add new objects in a probabilistic 
fashion, to reach a total of 50 objects. We see that the feature repertoire is extended occasionally. The average discrim- 
ination success remains close to the maximum (1 .0) because hew objects are only encountered occasionally and the 
feature detectors already constructed are general. 

Fig. 7 shows, for the same experiment, the relation between the total number of features that are available and the 
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features that are used, we see that the repertoire of features created in the beginning is used much more extensively 
clearly showing 

Initially, not many new features are introduced by the available repertoire is used better: Later on new features are 
indeed necessary. 

Conclusions 

The present invention provides a mechanism for the creation of perceptually grounded meaning giving a set of sen- 
sory channels and a series of objects among which domination has to take place. The mechanism is based on selec- 
tionist principles. There is a generator of variety and selection pressure coming from success or failure in discrimination 
It has been shown that the system arrives quite rapidly at a set of possible features for discriminating objects. Most inter- 
estingly, the system remains adaptive when new objects are added or when new sensory channels become available' 

The present invention provides a method for extracting features which characterise objects, and has been 
explained in general terms. However, it is to be understood that numerous concrete applications are possible In typical 
applications, the "agent" seeking to characterise objects is a robot or a computer-based system. Also, in general the 
sensory channels may be linked, for example, to sensors of physical parameters, such as to visual, auditory, or internal 
sensors. 

The feature extraction method of the present invention provides, in effect, a means of automatically determining a 
set of rules which characterise a particular object and permit the object to be discriminated from the context in which 
the object is placed (usually, a set of objects). This characterisation can be used for a wide variety of purposes For 
example, in a case where the "agent" is a robot which needs to navigate in a space which may contain other moving 
objects, the ability to characterise objects enables the robot to detect and track individual objects, even those of a kind 
not previously known to the robot, with a view, for example, to avoiding collisions. 

Many applications can be envisaged where the feature extraction method of the present invention is applied as a 
preliminary step and then, in subsequent operation, the robot or computer system concerned sorts objects (either ones 
used in the original feature extraction process or new objects coming into the field of attention of the robot/system) into 
different groups by making use of the characterisation thus obtained. Furthermore, preferably, the characterisation is 
refined, as a dynamic process, as new objects enter the field of attention of the robot/computer system 

In some applications, it mayjse useful to send an unmanned vehicle into a hostile environment and command a 
computer system on-board the vehicle to put into practice the feature extraction method of the invention and to broad- 
cast details of the best feature discriminating set that has been found. The feature discriminating set can be analysed 
cu t0 u d !! ermine What different types 01 <** 6018 <*" be distinguished by the computer system on-board the vehicle 
Should it be desired to remove certain types of object from the hostile environment, or to perform some special type of 
operation™ such types of object, then an instruction identifying such types of object in terms of features which have a 
meaning for the computer system on-boaid the remote vehicle can be transmitted to that computer system 

Numerous other applications are possible, where the feature extraction method of the present invention is used 
automatically to identify individual members of some population and. thus, to enable gathered information to be cor- 
rectly attributed to the different individual entities. This can be a powerful technique tor gathering experimental data 
especially in remote or hostile environments. *» ' 

This feature extraction of the present invention Is performed automatically and dynamically and so. as mentioned 
above, is particularly suited for application by devices which need to operate autonomously or semi-autonomously. 

Many further concrete applications of the method according to the present invention win occur to the skilled person. 

Claims 

1. A method for extracting features characterizing objects comprising: 

discriminating an object from a context, the step of discriminating including 

(a) determining the context consisting of at least two objects. 

(b) choosing a topic object from the context. 

(c) deriving feature sets of the topic object and the other objects in the context. 

(d) judging whether there is at least a distinctive feature set in the feature sets, 

(e) deriving a new feature set if there, is not the distinctive feature set in the feature sets and 

(f) registering one of the distinctive feature sets as an outcome; and 

re-starting the step of discriminating when an object not discriminated from the other objects exists. 
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2. A method according to claim 1 , wherein each feature of the feature set is expressed in a pair of an attribute and a 
value. * 

3. A method according to claim 1 or 2, wherein each feature of the feature set is derived by a feature detector seg- 
5 meriting a continuous space of a first sensory means. 

4. A method according to claim 3, wherein the step of deriving a new feature set comprises: 

if there is a second sensory means having no feature detector, creating a new feature detector on the second 
w sensory means. 

5. A method according to claim 3. wherein the step of deriving a new feature set comprises: 

if there is no second sensory means having no feature detector, creating a new feature detector on the first 
is sensory means. 

6. A method according to any of claims 1 to 5, wherein the step of registering comprises: 

judging whether there is the smallest distinctive feature set; and registering the smallest distinctive feature as 
20 the outcome if there is the smallest distinctive feature set. 

7. A method according to claim 6, wherein the step of registering comprises: 

judging whether there is the distinctive feature set having the smallest number of segmentation if there is not 
25 the smallest distinctive feature set; and 

registering the distinctive feature set having the smallest number of segmentation as the outcome if there is the 
distinctive feature set having the smallest number of segmentation. 
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8. A method according to claim 7, wherein the step of registering comprises: 

registering a feature set having been used the most as the outcome if there is not the distinctive feature set 
having the smallest number of segmentation. 
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Figure 1: Feature perception is the process of going from an object to a 
feature set in two steps: sensory channels contain states from sensors and 
sensory routines, and they are transformed into features by feature detectors. 
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Figure 2: Discrimination is the process of comparing two feature sets to find 
the discriminating features. 
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Figure 3: Feature detectors grow hierarchically as needed by the task domain. 




Discrim. success 
Total d'tscrim. 



Figure 4: — 

The average success in discrimination games as well as 

the global success is shown on the y-axis. The number of discrimination is 

mapped on the x-axis (scale 1/10). All objects can: be discriminated after 

150 discrimination games. 
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Figure 5: The graph plots data for the same experiment as in fig 1. The total 
number of features and the percentage of features used of the total available 
at each time moment. 




Figure 6: Graph showing a steady increase in the number of objects. The 
graph shows on the y-axis the number of objects (as a percentage of the total 
reached at the end, i.e. 50), the discriminatory success which remains close 
to the maximum, and the number of features (as a percentage of the total 
reached at the end, i.e. 35). The x-axis plots the number of discrimination 
games (scale 1/10). 
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Figure 7: Graph showing (on the y-aaris) the relation between the increasing 
total feature repertoire and the percentage of the available repertoire that is 
used. The x-axis plots the number of discrimination games (scale 1/10). 
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